Skip to content

Conversation

@ParkMyCar
Copy link
Contributor

This PR makes our Bazel build fully hermetic, mainly by refactoring how we built the librocksdb-sys crate. Previously we had to rely on some hacks because librocksdb-sys uses bindgen which was tricky to get working.

Specifically the changes this PR makes are:

  • upgrades to clang 18.1.8-5
  • upgrades to newer version of toolchains_llvm that includes an upstream fix
  • adds rust_bindgen toolchains with new libclang package from our toolchains repo
  • refactors the rocksdb build to be hermetic

Motivation

Improves the quality of our build, allows us to move to a "minimum" CI builder image for faster build times

Tips for reviewer

Checklist

  • This PR has adequate test coverage / QA involvement has been duly considered. (trigger-ci for additional test/nightly runs)
  • This PR has an associated up-to-date design doc, is a design doc (template), or is sufficiently small to not require a design.
  • If this PR evolves an existing $T ⇔ Proto$T mapping (possibly in a backwards-incompatible way), then it is tagged with a T-proto label.
  • If this PR will require changes to cloud orchestration or tests, there is a companion cloud PR to account for those changes that is tagged with the release-blocker label (example).
  • If this PR includes major user-facing behavior changes, I have pinged the relevant PM to schedule a changelog post.

@ParkMyCar ParkMyCar force-pushed the bazel/rocksdb-bindgen branch from 8700093 to 1ee42f1 Compare January 12, 2025 19:28
* upgrades to clang 18.1.8-5
* upgrades to newer version of toolchains_llvm
* adds rust_bindgen toolchains with new libclang package from our toolchains repo
* refactors the rocksdb build to be hermetic
@ParkMyCar ParkMyCar force-pushed the bazel/rocksdb-bindgen branch from 1ee42f1 to 641ce0e Compare January 12, 2025 19:30
@ParkMyCar ParkMyCar mentioned this pull request Jan 12, 2025
5 tasks
@ParkMyCar ParkMyCar requested a review from def- January 12, 2025 19:37
@ParkMyCar ParkMyCar marked this pull request as ready for review January 12, 2025 19:37
Copy link
Contributor

@def- def- left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems great!

@ParkMyCar ParkMyCar merged commit 8f8ae3f into MaterializeInc:main Jan 13, 2025
156 of 158 checks passed
@ParkMyCar ParkMyCar deleted the bazel/rocksdb-bindgen branch January 17, 2025 15:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants